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Abstract 



Three ^)robrem8 in the use of eye movement data for the study of language 
processing ar^ 4i3cussed: the perceptual span problem^, the data summary 
problem, and' the eye-mind lag problem. Recent research on perception during 
/reading is described which bears on these problems., Finally, a general 
^*^[^p*oach to the use of eye movement data for studying laf^uage processing Is 
presented, based on present knowledge of perceptual processing and eye 
movement control during reading* « 




Language Processing 

2 ^ 

Toward the Use of Eye Movements In the Study ^ 
of Language Processing 

V 

It Is our desire to study the nature of skilled, silent reading and to 
describe t/Me perceptual and language processes^ that are taking place as 
reading Is In progress* This la difficult to do because there are few 
outwardly observable Indicators of the rich and complex mental activities 
occurring during reading. Eye movements are one such Indicator* VThlle past 
decades oi, research on eye movements In reading have not been particularly 
helpful In understanding the nature 'of reading^ this situation Is changing* 
In fact» we are cc»alng to realize that eye taovement* research Is critical^ to 
the Investigation of. the ongoing processes during reading* 

This claim boncernxug the Importance of eye movement monitoring Is 
based on the following argument* In order to study processing as It Is 
taking placet it Is necessary to know what stimulus Information Is being 
encountered at any given moment In time* This problem can be illustrated by 
looking at studies of comprehension of oral language* Here the presentation 
of the stimulus Is to a great extent under the experimenter's control* The 
experimenter can determine approximately when a given part of the auditory 
signal will strike the listener's ear* While there is some Indeterminacy in 
knowing just when a phoneme begins and ends> or when a word can be anid to 
have been perceived^ there is still sufficient access to and control over 
the stimulus to permit the placement of a click at a sp.^clfic location in 
the speech stream, or to measure che response time from the occurrence of a 
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particular phonane* Knowing when specific aspects of the stimulus are 
encountered provides a basis both ft>t making ©anlpulatlohs and for making 
measurements with respect to certain aspects of the stimulus, when studying 
languaige ptocessing* 

In reading, however, ^he text Is physically present at all times, and 
the- reader controls the sequence and timing of its encounter. Thus, it is 
more difficult to know exactly when contact is being made with a particular 
letter or word, in order to make manipulations or measurements with respect 
to it. Eye movement recording ..is the 4nost likely candidate for providing 
such information. For exanq>le,- we may examine eye movement records to learn 
how much time passes after a person ^encounters an error in the text before* 
he/she responds to it in some way, such as by making a regressive eye 
movement* Or we may use eye movement information as a basis for presenting 
some auditory signal (for Instance, a word or click) as the subject Is 
reading a 'particular word in the text* For many purposes the'monltoring of 
eye movements is a basic technology for the further study of ongoing 
processing during reading* 

A second Important use of eye movement monitoring Is as a source of 
data* More and more evidence Is accumulating to indicate that where the eyt^ 
Is sent and how long It remains at each location is specifically controlled 
and reflects various aspects of the mental activities of the reader (Rayner, 
1979; Levy-Schoen & O'Regan, U979)* The use of eye movement records as a 
source of data will be dlscuosed further and Illustrated Ir'jter In this 
pa pe r • 
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First, hpwever. It 13 important to note some of the problems Involved 

In using eye movement informatlpn for.elther p.jurpose (l*e«, for experimental 

control or as data) aside from the technical problems of obtaining accurate 

records « The problenia, Include the< following: 

!♦ The perceptual span problem^ Eye movement records directly Indicate 

* * 

• • /J 

where, the eye was centerel for a given person on a given flxatloiw They do 

not by themselves Indicate what region of text was seen during that fixation 

(or whether any t4xt was see^ ^ for that matter)* Thus> 'while the record may 

Indicate the general region f torn which visual Information is improbably being 

* 

obtained during a fixation^ It does not Indicate on which fixation or 

j^lxatlons a glv^n word is being encountered* As an exan^le of a situation 

(ih which this problem arises, in experimenter ma^ believe that the time a 

person requires to press a button when a click sounds * provides an Indication 

of the person^s cognitive lo^d at that moment In time* The experimenper may 

have a hypothesis that the reader^s cognitive load is greater at one place 

• » * 

in the .text than at some other place because of a difference In the language 

* « 

processes believed to be occurring at those points* To test t,the h/pothesls, 
the experimenter wishes to sound a click during the fixation on which . ^ 
particular words are being seen* Only wl^-H greater i/ntierstandlng than we 

currently have about perception ddring fixations caii eye movement 

*■ 

information be used accurately for such a purpose* There is a parallel 
probltm in. data analysis, as discussed next* 

2» T!ie data summar y problem * Theories of language processing of tin 
m*ike predictions abcMit the fol/iftve amount of procrssing time r^njuittvl at 
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different pointi in the text. Eye moveaelit records seon like a natural 
source for such information. For instance, one may wish to test the 

hypotl^esis that the primary meaning of a word* with several meanings can be 

• . ' , ... 

accessed faster than the secondary meaning (Hogaboam, 1^78). If this is so, 
one ahould be able to obaerve shorter fixation' durations on such words when 
the context calls for the more common meaning* However* without knowing 

exactly which region, of text was being seen on a given fixation^ it is not 

« 

possible to reliably identify the fixation on which the word of interest was 
encountered* In fact^ it Is possible that the word was seen on more than 
one fixation during the reading. .This makes it difficult to know Just which 
fixation durations to use^in the data analysis in order to provide a clean 



test of the hypothesise Itils lyroblem is compounded even further by ^he next 
problem* 

3* The eve^mind lag problem > Wt)ile the abpve problems havfe addressed 

the difficulty of knowing on which fixation a given word is being 

encountered* there is a further problem *of knowing when the effects of the 

processing of that word will be reflected in the-, eye movement pattern* If 

ambiguous words do have the ^fect hypothesised above* will the greater 

processing t*ime be observed on the very fixation on which the word is 

visually encountered* or does the meaning "Identification for that^ word occur 

only at some later time? For instance* if meaning identification is -delayed 
♦ 

for 300 msec* the reader will probably have made one or two further 
fixations) and hence be looking at some other word in the text* An Increase 
or decrease in processing time would only be seen in later fixations* Thus* 
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*in order to know't4>ere In the data i^edord to. look, for a longer fixation 
duration, or when t9 produce an experimental manipulation that is to occur 
simultaneously with a particular mental event, it is necessary to know how 
long fallowing Visual perception ^of 9 woM the mental operation of Interest 

• ' ' . ^ / < : ■ ■ 

is actually carried out* Research ou the eye->voice span in reading 
indicates a substantial time (Qeyer, 1968, suggests one second) between, the 
' perception and the vocalization of words in -reading, aloud* Of , course, it 
, could still be tl\^t the understanding of the word, occurs almost Immi^diately 
upon its percept ion, "-with only the vocalization being delayed (we will later 
suggest that this appears- to be 'the case in re^kding)* For the present it is 
sufficient to point out that this lag between- visu^' encounter of 

» , * 

information apd the carrying out of • higher mental activities involving the 
use of that inform<^tlon 4? A problem that must be addressed before eye 
.mbveoient data can be wisely us:id to test hypotheses about language 

* » 

proce88ltH»« 

Thu8> while eye movement data offer promise for playing a central role 

» > 

in the study of language processing in readings there are some, prior 
^qdestions about perception and eye movements themselves that must be 
resolved firsts These are the questions of what is seen during a fixationt 
when it Is seen> when this information has its effects on comprehend ion ^ and 
how the mind determines when and where to send the eyes. ^ Different answers 
to these questions would lead to different Inferences about reading based on 
the same set of eye movement data* For Instance^ If the eye^s are simply 
being sent random distances along the line during saccades^ spet:lflc eye 
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• . • • • • « 

♦ * 'i 

position infomation is not likely to be useful in testing theories of 
language processing. But If the ey<e is being sent to a preplanned location 
on each eye noveoent, eye position Information may be very useful for this* 
purpose* It is to research on these questions which we now turn* 

• * * 

• Some Studies of Perception During Reading 
Is. -the Eye being Sent to Specific Locations During Reading ? ^ 

There has beei^ considerable speculation that it matters little* where 
the eye is sent during reading, an4 that> there may be little specif i-c 
control' of eye movements other than insuring tbat the eyes are pro9eedlng 
down the line of .text at an appropriate rate to provide visual input for 
reading (Bouma'^& deVoogd, 1974; Shebllske, 1975)* If this ijere true, we 
woniild not 'expect eye movement data, to yield much specific information about 
the processes involved in reading,* To Investigate this question, Mc^nkle, ' 
Wolverton, and Zola (Note 1) shifted the entire line of text two letter 
positions to right or left during certain saccadic eye movements as subjects 

H 

were reading* This caused the next fixation to be located^ at a slightly 

different place in t|ie text than irould norofally have been the case*. The 

question was whether this would have any effect on the reader* There are 

two results to report from this study* First, the readers were unaware that 
\ 

the text had moved* Second, however, this manlpulaflon had a definite 
effect on the eye movement pattern. A shift to the left, which placed. the 
next fi> tion two letter positions further into the text than would normally 
have been the case, caused a large number of short regressive eye movements 
of two to three letcer positions in length. A shift to the right, which 



ERIC 



* ^' , . tanguage Processing 

8 

.caused the eye to fail short of the location to which it was sent, reduced 

'* ' * * * , 

by half the nunber of regreasive <^e novenents wliich normally occur*' Thus,*^ 

It can be concluded that the eyeb were being sent to a specific location; 

arriving at a position only two letter positions away had a definite effect 

ft • 

on the normal reading patterne 

• • * 

Is^ the Text beln£ Seen During Saccades> or Only During Fixations? 

The answer to this question will indicate whether t;he ^.subject may be. 

encountering words t^B the eye is in flight, or whether this pccurs only 

p ' ' \ ■ ■> • ' 

during fixatijoris while the ^ye is relatively still* Thus it may influence 

when an investigator shquld make 8t:jnulu8 manipulations, if they are to cb- 

•> 

occur with the perceiving of a word! for instance. Wolvertqn (Note 2) 
inveatigated this question by causing the line of text to be replaced by 
some other line for up to 30 msec during certain saccadese . He then examined 
the durations of the next. two fixations^ and length of the next saccade^ to 
determine whether there was any evidence of disruptionV This maDipuiati9n 
had no significant inf lue • on the reading -pattern. Our subjective 
experience with this manipulation is that when the text is blanked out 
furing the sa^cade this .is highly noticeable ^nd is perceived as an* abrupt 
flicker. However, replacing one line of 'text by another, or by % string of 
X's, is not noticed by the reader. Thus, it appears that the reading of the 
text occurs ouX^ during fixations. This means that many types of changes in 
the text can be made durli7g saccades without the subject noticing the simple 
occi}rrence of change (for example, see McConkie & Zola, 1979)* If the 
change is detected, it is becattse a dlfterence Is noticed in the pattern 
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^ffoni oafi(,.£;Lxatlon to the next* It ^Iso means that the, experimenter, under 

J • ' ^ ■ ' . • \ 

most clrcumstahces, nee4 not be concerned with ii^ormatioQ b^ing acquired 

.I. ' ' • 

du.rj|ng saccadic eye movements, and can deal only with vision 'during 

flxjtions. . ' ^ . • . , ^ . 

I - ^ • • 

! * . . ^ .. 

JAi£^ During ^ Fixation JL£ Visual ^Information being Acquired ? 

; • . 4 " r . 

i While it a^pecrs that readers pick, up language information from the. 

I * • * 

texjt Only during fixations^ this still does not indicate when during the 

M ■ • ■ . '■ • ■ ■ 

. . -c^Atlon such information is acquired*, Does this happen only at the 
beg,inning of each fixation, wt.r.h the remainder of the fixation time devoted 
*cj ilanguage processing activities, or is visual information acquired and 
used as needed throughout 'the fixation? Volverton ($ote 2) continued the 

iKtudy just described by replacing the line df text iteiih somo other line for 

. . 

a 30 msec peribd at dlffei^ent times during certain ^fixations: either as 

sooh as the fixation began,.* ,or 30, 100, or 200 msec after, its b^itining* 

The replacement line was either the original line of text (as a control 

condition), or a line of blanks, of .X s, of some totally unrelated line of 

text, or a line of letters each selected as the letter m it visually similar 

to the original -letter in the text* The X's and unrelated line of text had 

the largest effect, Icausing an increase in tbe duration of the fixation 

during which tlvejnanlpul/itlon was made* Blanks and similar letters had less 

effect* However^ the point of Interest here was that such effects were 

» 

found %ihen this replacemecfit occurred at each of the times during the 
fixation* Thus there is no point during the fixation at which the visual 
system is insensitive to the textual stimuli because of saccadic suppression 
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♦ 

or Realise visual Input has been coopleted* It appears that the acquisition 
of. visual Information Is likely occurring througHout the f lxatlon» as needed 
to sjipport language' processing* - 
* There Is a related observation which we have made several times during 

» - » • * 

pilot studies.; We have had subjects read text'ln which either qf two words* 

: ■ ^ \ ; - ■■ . ■ 

1 «- 

differing In a single letter, would be appropriate In a certain word 

position (fbr exanqple* brain and brawn >♦ Eighty tasec after the onset of 

each fixation, the t^t has been masked by a 20 msec presentation of a row 

of X's,<ur has been shifted one letter position to right and .then left* The 

text then reappeared but with the critical letter changed* Thus, one word 

wa» in that location during th^ first part of the^ f ixatlt)n* and a differ^t 

word during the latter- part, with a general pei^urbatlon of the text in. 

between* which reduced the obviousness , of change at the critical letter 

position* Following, reading, the subject waa asked a question, the answer 

to which would indicate which of the two words'had been seen in that word 

.location* Sonetime's the subject has reported seeing 'only the first word 

''presented, .sometimes only the second', and. sometimes has reported seeing both 

^ "'. ■. 
words* This suggests .that given text region is sometimes read during the 

>•> . ■ • ^ . 

early part of a< fixation, &nd sometimes during the latter pairt* Thus it 

seems likely that visual information is being used from different text 

regions at different tiroes during the» f ixationt as needed for the, language 
*^ 

processing of the moments * 
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Js. Vlaual Information from the Same Textual Region being Seen on More than 
One Fixation? • ^. 

') Smith (1971) suggested that during reading the person sees the sane 

■ •" • 

word oin more than one fixation, and that this contributes to accuracy in 

c 

reading. Bouma (1978) has suggested that Information acquired from the 
visual peripheral regions during one fixation, and corresponding Information 
from the central visual region on the ^next, reach the brain at about the 

4 

same tlme« thus reinfo;?6ing each other and enhancing perception. To test 
this, McConkle (Note 3) identified pairs of words which differed in a single 
letter. These were five letter words differing in the fouruh letter 
(brain-brawn, leads-leaks , etc.). Sentences were prepared in which either 
word appropriate* Then subjects read these sentences as their 
movements wer-e being monitored* * Durlr^ each forward saccade which t ailed 
at least three letter positions, the letter distinguishing the two words was 
switched* Thus 9 one word appeared In the sentence during one fixation, the 
other during the second, the first word during the next fixation, etc* The 
subjects were coQ^)letely unaware that any change was taking place, and were 
able to report the word they had seen In the sentence* Furthermore, this 
changing of words had no effect on the readers^ eye movement patterns* 
Thus, it appears that a particular letter is being Identified on only a 
single fixation, with the possible exception of cases where a subject 
regresses back to a word after having read It earlier* If this conclusii n 
continues to receive support, it simplifies the use of eye movement data In 
readiriK rt search* It Justifies the notion that there is a particular 
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fixation on which a letter, letter' group» or word can be said to be 
perceived* If the same text region was being seen on several successive 

t ' 

fixations, it would be ouch less clear Just which fixations should te . 
considered critical to the perception'^ of that region/ 



f 



What Region of Text is being Seen During a Fixation ? j 

The finding that- subjects are acquiring information from^ given letter 
position during only a single fixation place^ severe constraints on the slse^ 

of the region from which visual information is being used during a fixa|^lon. 

. / 

Since the average length of saccades during rekding is about 8-10 l^etter 

I ^ , 

positions, even with good readers, we are inclined to believe 'that this is 

about the size of the region being seen during a.flxatlon« McConkle an5ji 

Rayner (1976) found that replacing text more than four letter positions to 

the left of the fixation point during each fixation had' no adverse effect on 

the subjects' reading behavior; It appeared that visual information in that 

region was not typically being used for readilig. Appar* ntly reading is 

taking place ho a greater distance to the right of the fixation point than 

to the left, a point which has received additional evidence in another study 

^ (McJConkie, Note 3). 

One reasonable possibility is that feaders typically cast their eyes to 

a position near that to which identification was successful during the prior 

fixation (McConkle, 1979) ♦ Further research is exploring this possibility 

at the .present time* 
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While niucJ\^iiK>re research Is needed on this question, It appears that 
during a fixation In reading > the subject Is acquiring visual informa^on 
from a relatively narrow region of text, the size of which may vary from 
fixation to fixation, but which lies asymmetrically to the right of the 
center of vision and which may be indicated by the locations of the present 

r 

and next fixations* * 

Do Lanauaae Constraints Influence What is Seen During a. Fixation ? 

There .has been much written about how language constraints permit the 
reader to Identify words or in-»ajnlrgs In the text with the use of less visual 
Information, thus allowing reading to pccur at higher speeds. Primary 
evidence for thia position has been the work of Tulving and Gold (1963) and 
Morton (1964) who have shown that the visual duration threshckd for words 
can be greatly reduced by giving appropriate prior linguistic context*' This 
theme has been picked up by many writers who have suggested that readers 
form hypotheses or guesses about the language which they will next encounter 
in the text, and that only minimal visual information is then required to 
confirm or dlsconfirm these guesses* Under high constraint conditions, very 
little visual information should be needed* 

Zola (Note 4) has explored this question by developing paragraphs in 
which the predictability of one word in the text depends on which of two 
words precedes it* In one Instance, for example, a pa?>bage about a thtMter 
speaks either of buttered popcorn or of adequate popcorn* In norms 
previously gathered, it w^s found that when the highly constraining word was 
present (e*g*, buttered^), people guessed the next w«^rd ( popcorn ) with 
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accuracies averaging over 85%« When the lew constraining word was In that 
location (e*g«9 adequate )m the target word was guessed with accuracies 
averaging less than 15%« Thu8» in reading^ much less visual information 
should be needed from the target word under the high constraint condition^ ^ 
if readers are making and confirming hypotheses as suggested* To test'thl8> 
another group of subjects read one or the other of these two versions of 
each passage while their eye movements^ were being monitored* (No stimulus 
changes took place during the reading in this experiment)* The first 
question was whether subjects would be less likely to fixate the target word 
when it was highly predictable* this wds not the case* Under high 
constraint conditions^ 98% of the. s,td)Jects fixated the target word^ and 
under low constraint cohdltlons> 96% did* Thus^ subjects did not skip over 
the word when it was highly predictable* The second question was whether 
less time was spent on the word when it was highly constrained* Here it is 
necessary to distinguish between total time spent fixating that word during 
reading vs* the fixation duration of the first fixation on the word* Less 
total time was Indeed ,A>p6n4 ^ft--&he word in the high constraint condition^ a 
difference of 23 msec* This difference appears to come primarily from a 
reduced 'likelihood of regressing back to the word after having read tt 
earlier* The durations of fixations n the word as it was first being read 
also show a small advantage for the high constraint condition, a difft^rencf 
of 9 msec* Thus, a lar>;e difference in language constraint does appear to 
produce a small difference in the duration of a fixation on f hat word in the 
text. 
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Zola then vent on to test whether less. visual Information was being 
used from the target word under high constraint conditions than under low* 
He did this by p.^aclng errors of various degrees In the target word. The 
smallest error was to replace the fourth letter with the letter most 
visually similar to It. This consisted, then, of a very saall change in the 

« 

Visual configuration made at a highly redundant location In the center of a 

word* There seons little question but that this change involved visual 

information that is not required for word , Identification under high 

constraint conditions^ However) even this minimal error had 'an effect on 

reading: It increased the average duration of fixations on the word by 20 

msec (as compared to 25 msec under low constraint conditions) » Increased 

total time spent fixating the word by 63 msec. Us compared to 125 msec for 

low constraint conditions), and Increased total reading time for the line by 

125 msec (as compeared to 261 ms^ c for the low constraint condition)* Thus, 

this study provides no evidence that even the most minimal error in a word 

la passed over during reading under extremely high redundancy conditions* 

There is no evidence here that the reader is essentially anticipating what 

is to come next and then acquiring only t visual information necessary to 

confirm or reject the predictione Instead, the reader appears to be 

responding to the full visual detail of the text in the act of reading, even 

« 

when that detail may not seem necess iry from an information theoretic point 
of viewe 
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How Much Lag Is there Between the Tlme^ Information Is Viauallv Encountered 
and, the Time When It Is Used for Reading ? 

A number of people have suggested that th^re may be a buffer of some 
•sort Into whlcl^ Information Is being placed as a result of visual analysis ^ 
<\f the text, and from which the language processes can then draw as needed 
at some later time (Bouma & deVoogd, 1974;); Shebllske, 1975)* If this were 
C)ie case^ the text bexng understood at any particular moment In time would 
not be that which was being visually perceived* It also seems possible that 
there may be a series of stages in which the information is used for making 
successively higher Integrations of the word or words which permits the 
perception or construction of that meaning «nd that there may be some delay 
before the final stages are reached. For the present purposes, we will 
simply focus on the question 6f whether^ such .a considerable lag occurs t 
since this has important implications for the use of eye movement data. If 
there were a large lag, the effects of language processing stimulated by one 
part of the text would only be observed as the person was looking at some 
ottJ^r part of .the text, one or core fixations later. This would make the 
use of eye movement data much more difficult* This is essentially the eye- 
mind lag problem mentioned earlier* 

This question cannot be answered definitively at the present time. A 
partial answer, however, can be given* It Is clear that manipulations of 
the visual stimulus can have an immediate effect; that is, the effects 
produced by stimulus manipulations In the studies described ^^^irller are 
typically seen on th<* duration of the fixation on which the manipulation 
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occurs, or. on the sacdkde iminedlately following. Rayner (1975) changed the 
contents of one word position, during a sacc^il% and found that this Inflated 
the duration of the fixation on which the changed word was first 
encountered. Wolverton (Note 2), as reported earlier, found that replacing 
text with some other line for a 30 msec period Inflated the duration of that 
fixation. McConkle, Wolverton, and Zola (Note 1) found that moving the text 
a short distance during a saccade affected the probability of the next 
saccade being a regression. Thus, such stimulus manipulations as thede haVe 
an effect which occurs within the period of a fixation* ' 

Though less well establlshedi it appears the characteristics of words 
can influence the duration of the fixation on which they are* perceived* It 
has comiQonly been reported that numbers and less common words tend to 
produce longer fixations (Woodworth, 1938), observations which we have also 
replicated* O^Regan (1979) reported" a tendency to skip the word the during 
reading sentences with certain syntactic structures* Howevetf as tevy^ 
Schoen and O^Regan (1979) point out, this evidence is less convincing 
becai^/e it Is possible the word was perceived peripherally on the fixation 
prior to that on which the effect was observed* While this possibility 
remains, what we have learned about the size of the perceptual span makes It 
appear highly probable that the variables were having their effect on the 
fixation during which the Ciftlcal text region (the word or numher) was 
being perceived* 

Finally, at present there is practically no evidence concerning the 
amount of delay before higher-level pi ->i easing takes place (for infitanco, 
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before the Sftmantlp relation between a verb and Its direct object is 
perceived, before the referent of a pronoun is' established, or before the 
relation of the Ihfa.rmatlon In one sentence to prior Information Is 
Identified In normal text) # Isakson (1979) provides some evidence that 
semantic Integration cmn occur very rapidly^ ^nd Danks and Fe^ars (In pres«) 
preseats data on oral reading that suggests that soo^ forms of Integration 
occur prior to others* Still this remains an Important question needing 
* Study before we can have full confidence In using eye movement records for 
the study of these aspects of language processing In reading* 

The Study of Language Processing 

In this section^ lire will attempt to describe a way of conceptualizing 

* 

the relationship between eye movements and language processing which seems 
compatible with findings from the research described above (McConkie^ 1979)* 
While it cannot be claimed that existing research has strongly supported 
this view over caiq)etlng possibilities^ this approach does seem to be in 
harmony with the observations madp so far> and it helps clarify just what 
Information eye movements *night contribute to our understanding of language 
processlnge In addition^ two examples are provided of studies which 
Investigate questions of language processing using eye movement data* 

How do Eye Movements Relate to Language Processing ? 

It Is assumed that the reader Is primarily involved in ttie attempt to 
understand and remember the concepts and relations being expressed in the 
texte In st.pport of that activity^ visual Infonnatlon is acquired as it is 
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needed during the fixation In order to nake the' Identifications, 
dlsJrlalnatlbns, atid /or decisions that are required, and that can be based 

on the visual Inform^ttlon. Thus, visual Information is taken, not from some 

✓ " ' @ J ... 

buffer, but directly ^rom Input from the retina as it Is needed throughout 
the fixation, with information used from different regions at different 
times. ' 

At some time during each ^fixation, visual information is sought from a 
retinal region from which the nf^ded level 'of detail is insufficient fo»r the 
present purpose. It is this evexit which triggers a saccadic movement. The 
eye is simply rotated the direction and di'stande^reduired to cause the 
region from which visual detail i^being sought to lie on the fovea, closer 
to the cedter of vision.- Just vhete the eye tends to be centered with ^ 
respect to the location of the needed vis^l information a question 
requiring further study, but it appears €o be centered rather close to it. 
Reading, then coptinues along the line from that 'point during the next 
fixation. Thus, there is little overlap from fixation to fixation in the 
region from which visual detail is taken and used for reading, and this 
region tends to extend primarily to the right of the center of vision. In 
the ev.nt that difficulty is encountered, a reconsideration of previously 
read text may be necessary. Again, if the region from which visual 
information is needed is suf. ciently far^from the center o?. vision that the 
level of detail required ia not readily available, a regressive eye movement 
will be Initiated. 
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At wha,t point the level, of needed detail will be Insufficient will vary 

with a number of variables,^ such as the redundancy of 'the language at that 

point in the tqxt,. just which alternatives must be' distinguished at that . 

.point, the reader's cxpterlence in using the redundancies in the language in 

reading, e'tc« This assumes that cqntextual information can assist in the 

l^entif Icatlcm of a word in peripheral vision, permitting identification 

whvn less than the full, visual de^fiail is aval.'ablu, Vnd that Just what 

» * .. 

detail l8 needed depends In some way on alternative words that would be 
appiroprlate In thS^ contex<:« . '^xxSf although' the mechanl&^a for eye movement 
control may be simple, with the eye simply being sent to the region from 
which vlarual detail Is sought but Is not readily available. In fact, the 
lengths of saccadeB reflect chtaracterlstlcs of the language -and the reader ^s 
knowledge and skill* Thl^ way of thinking of eye movement conti^^il suggests 
that the .ye movements are under precise control, but that this control Is 
not based< 6n predictions, nor on any sort of "preattentlonal^V analysis of 
peripheral Information used to decide where the Inf orqiation-rlch regions 
will b^ In the text* On the other hand, the eye movement patterns do 
ref lect ' language processing In a detailed way* 

I£ the basic assumptions of this viei* of eye movement control are 
generally correct, then it' follows that eye movement records provide two 
types of information that may be of use in understanding language 
processing* First, the location of each fixation indicates the place in the 
text from wliich visual detail is being sought at the beginning of that 
fixation (and at the end of the prior fixation) • Thus, the eye serves as a 
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markert placing benchnarks (fixation locations) which intermittently 

r » 

indicate Just where visual infonsatib^ is being spught* Of course^ the eye 

♦ ■* * 

movement record by itself does not indicate where visual information is ' 

being sought at other times> just as benchmarks do ndt indicate the 

elevation of the terrain between two markers* However/ further research 

should produce some general principles concerning this* Second^ the eye 

movement record indicates how much time- elapses between the seeking of 

information from theee specific locations* This information is given by the 

fixation durations^ which can typically be taken as the time required for 

carrying out the processings to some as yet undetermined 1 vel^ using the 

visual information acquired during that fixation* This quallf icationt **to 

some as yet undetermined level^^* reflects ciur lack of knowledge about the 

speed with which this processing occurs (part of the eye^mind lag problem 

mentioned earlier)* 

From this brief description^ it can be seen that we expect the eye 

movement record to provide useful information about the time required for 

language nrocesslng activities 6f various types to be carried out^ and 

information about w*hen the reader seeks visual information in other than the 

normal ^eft^rlght sequence of residing* We will now provide two exao^les of 
V 

the use ot. this Infonnationt and then de 2rlbe a general approach to the 
problem of analyzlnq eye movement data iu a manner which will be useful for 
testing theories of language processing* 
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« . The Identification of Anbfguoufl Words During Reading 



One aspect of language* processus during, reading concerns the way In 
vhich meanings of words are irousei and/or selected* Muck of the research 
^ on this problem of lexical^ access has involved words which have more^ than 
one distinct meaning, 8</ch as l>ank (financial ijistltutlon, land alongside a 
river, a naneuviBr made by a flying o)}j%ct such as an. airplane)* When such a ' 

^ word is encountered, are all meanings aroused and only the appropriate one <^ • 

* ', * * • ' • , 
* selected for use (Foss & Jenkins, 1973), or does the presehce of context 

\ 

invoke some procedure by which only the appropriate meaning is aroused? 

Results involving recognition or recall teats tend to indicate that only the 

contextually appropriate meaning is encountered « Studies involving pl\.oneme , 

monitoring tasks find longer responise times for such* ambiguous words 

regardless of context » suggesting retrieval of multiple meanings* ^ Hogaboam ^ 

(1978) investigated this .questiotl using a task in which the ambiguous word ' 

•* * 
was the laet word in a paragraph, and the subject was to press a button as 

> * 

soon as, the meaning *of the word was understood* He found evidence of. faster 
responding to the word when the culturally most frequent sense waei the . '\. 
appropriate meaning in the context* This finding was taken to Indicate at 
the primary meaning is first aroused> and the secondary meaning i^ then^ 

•4 

aroused, only if the primary meaning was contextually inappropriate. 

Hogaboam (Note 5) replicated part of this Study, having subjects simply 
read the passages as their eye movements were monitored* He examined 
eye movement data to see if the time required for processing the aipbiguous ^ 
words differed according to which meaning the context demanded. Fixations 
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vhich centered oi^ the ambiguoitp ;»ord itself averted 36 msec longer when the « 
secondary meaning vajk required than when the primary' meaning was t6<l4i^6<l« 

Thus the pattertf £ouiid in ciye movement records supported the earlier pattern 

. . -. 

from the response time task, ani provided additional suf^ort* for the 

* • »♦ 

hypd^esis that seoondary meanings of w>rds are accessed only after primary 

meanings have been atoused and found inappropriate. 

One aspect of these da^a also b^ars on thta questipn of eye-mind lage ^ 

It is of interest that' the increment in fixation duration is found for 

fixations centered directly on the ambiguous words themselves » the fixations 

« on which fhe words were probably identifi^de Thus, the data suggest that, 

f I 

the use pi context select the meaning of an ambiguous word wafs occurring 

during the fixation on which the word was first identifiede This aspect of 

• ' I. 

language processing appears to occur with very short lag* 

.. Is there an Independent Comprehension Component in Understanding a Sentence ? 

Levelt (Mote 6), in his review of the sentence perception literature, 
has 4>ointed out that many studies dealing with sentence cooqprehension make 
the assumption that there is some initial, task-- independent stage in all 
su< h tasks during' which the sejntence meaning is initially comprehendede He 
called this the Immediate Linguistic Awareness (IIA) hypothesise Theories 
of sentence verification, for instance, accqunt for the effects of variables 
(aiatch vse mismatch of sentence voice, for Instance), not in terms of time 
to comprehend the sentence, but in terms of time to make mental 
manipulations of Lhat cqititent once the sentence is initially comprehended* v. 
While this makes theorizing simpler^ it is not clear that the assumption Is 
Justifiable* ^ 
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Tha tasting of the IIA hypothesis was a goal In a study by U»ca8 (Note 



7). Id his study, subjects read a first sentence ("A salesnah^iftoached a 

customer*") and then read a second sentence (for Instance, "A customer «as 

approached by a saXesoan." or "A salesman was approached by a customer*") • 

Following reading, they pressed one button If the second sentence was true. 

"V. ' ■ . I ». . 

With respect tp the first, and a second button 1£ It was not. Response 

■ ' ♦ * 

times Indicated that subjects respond faster when the 'two sentences match In 
meaning than when they 'do not (that Isy "true" responses are faster tl^in 

"false"), and ^ha.t responses are f Watermen the votce of the two sentences 

♦ . ' ' ' 

matclf. <both active or both passive) rath e than mismatch (one sentence^ls 

active, the other Is passive). This pattern of results Is typical of prior 

studies and has been accounted for by theories describing the effects as 

post-comprchenslonal in nature. In this ,stud> , however, subjects' eye . 

», - 
movements were also monitored. This made i^t jposslble to observe t^e time 

spent In reading the second sentence, allowing the determination of how much 
of the added time was due to slower reading vs. added "thinking time" 
following the reading. 

The eye movement data for "true" Instances (those Instances in which* 
the meanings pf the two sentences^tched) was broken down Into that portion 
prior to reading the last phrase in the sentence (called initial reading 
data ), and that following the reading of that phrase (called rereading 
data ). Initial reading data corresponded to the initial scan of the 
sentences. Each of these was further broken down into time spent fixating 
the first noun phirase, the verb phrase (with data from passive sentences 
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adjusted for phrase length) » and the second noun phrase# The results show 
that "even In Initial reading data» when the sentences differed In voice, 
subjects spent more time fixating the first noun phrase and the verb phrase 
(each averaging about 55 msec more time), as compared to data when both 
sentences were either passive or active* Subjects also spent about 98 msec 
more time fixating the second noun phrase during Initial reading when the 
sentence voice did noti match* However, It Is Impossible to divide that time 
into Initial sentence comprehension vs* postcoirprehenslon activities* Thuu, 
It Is clear that part of the added time produced by the mismatch condition 
is taken in slower reading of the sentence, indicating that at least the 
strong form of the IIA hypothesis is not an appropriate a8sumpti9n« At the 
^ame time, the mismatch condition also Increased the time spent following 
Initial reading of the jentence, beffbre the button was pressed* This time 
was increased by 298 msec* Thus, part of the increased time was indeed 
taken following the initial reading of the sentence, and was apparently 
spent in some sorts of con^)utations involved in matching the meanings of the 
two sentences, as the post-*comprehension models suggest* This latter result 
supports the position that, in this task, sentences are stored in a form 
related to the surface form of the sentence, rather than simply representing 
the meaning relations asserted* 

A General Approach to Use of Eye Movement Data 
While much of the research described above has focused on the 
perceptual processes occurring during reading, a motivating force behind It 
has been the desire to gain the information necessary to use eye movements 
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In titf study of language processing* This ^ectlori will describe a general 
approach .to this problem based on what has been learned about perceptual 
processes so far* 

It Is assumed that different parts of a text require differing amounts 
of processing time. Such differences arise from many sources. Some are the 
result oi the degree of complexity of mj^ntal activities required for 
achieving an understanding qf the relationships directly expressed In the 
text. Some are due to differences in syntax, word frequency, etc. Some. are 

» 

(1^ result of the inferences or other higher level processes stimulated or 
required by the text. Some are the result of the reader's knowledge or lack 
of knowledge about the topic under discussion, while others are the result 
of the task in which the reader is engaged, that is, what Information the 
reader is attempting to understand and retain. 

S When the different factors that Influence processing time are 
controlled to some extent, there should exist some basic similarities 
between subjects reading the same text. Thus, we can expect, among a group 
of readers with similar backgrounds who are reading for a similar purpose, 
some agreement in wh.-»£ parts of the text will require more and less 
processing time. If this relative amount of time required for each segment 
of text were known, this information could be represented by a contour over 
the text, where the height of the contour indicated the amount of time 
required for processing that part of the text. This will be called the 
iJealized proce ^ 'slng tim^ profile . An example of such a hypothesized 
profile is shown in Figure I, Stncf theories of language processing 
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^ Insert Figure 1 about here 

typically yield predictions of where In the text processing demands will be 
heavy or lights some approximation to the Idealized processing time profile 
^for a given passage could be used to test the adequacy of competing theories 

of language processing* Since eye movement data appear to reflect 

* 

processing time allocated to different portions of nhe text» It seems 
reasonable to attempt to derive from eye movement records an approximation 
to the Idealized processing time profile for any given passage read under 
particular circumstances* 

There are significant problems In attempting to do this* Firsts as 
noted t eye movement data do not directly yield a continuous record* Rather » 
they provide only Intermittent data* If the assumptions described earlier 
are correct ^ the duration of a fixation Indicates the time spent processing 
(to some level) the information lying approximately between the locations of 
two successive fixations when the subject Is processing In a normal 
rlghtward manner along the line* Stilly eye movement records do not 
Indicate the relative amount of time spent on different parts of that 
region* Second » different people do not fixate at the same locations* 
Thu8> It becomes difficult to know how to combine the data across subjects 
In order to obtain some sort of average processing curve* 

One approach to dealing with these problems and deriving a proces«lng 
time profile is as follows* Begin by considering a certain region of text 



Language Processing 

« 

28 

as being processed during a fixation* This region will be called the 
processing span and may or nay not be the same region as the perceptual span 
for that fixation* However^ for the present time we will assume that It Is 
the same* The basic assumption here Is that each segment or text provides 
information that is used in Interpreting the text. The Interpretive 
processes that are licensed by each segment of text differ for reasons noted 
above, but the processes that do occur take time and this time is indexed by 
the fixation durations* The fixation durations may reflect processes 
specific to the segment being processed as well as higher level integrative 
processes* licensed by that segment* Ideally we would like to assign the 
fixation duration times to exactly those portions of the text that were 
being processed on each fixation* As we have made the simplifying 
assumption that the area being processed is the same as the perceptual span, 
the fixation duration time will be allocated to, and spread over, this area* 
Since it Is not known where In that region more or less time was taken, the 
best strategy is simply to spread the time evenly over the region* One 
convenient way of doing this is to divide the fixation duration by the 
number of letter positions in the processing span, and assign the quotient 
to each letter position In the region* This is not to claim that processing 
is letter-by-lf -rter, but simply to use letter positions as a metric over 
text space for the present purpose* This can be done with any assumption 
concerning the processing span, considering it. to extend a fixed distance to 
left and right of the fixation point, or a relative distance based on the 
lengths of saccades. A number of such possibilities for the processing span 
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have been considered by Hogaboaa (Note 5), Including the possibilities of 
fixed vs. variable spans and overlapping vs* non-overlapping spans. For the 
present* In line with the foregoing comiaents, It will be assumed that the 
span is non-overlapping, and that It ,extends from the locus of one fixation 
to the locus of the next when bounded by rlghtward saccades* At present we 
do not know enough, about the characteristics of perception during fixations 
prec(sded or followed by regressions to know how to assign these times to the 
text* This must remain a matter for future research* For the present, %4me 
from such fixations must be either Ignored or spread over an arbitrary 
interval to the right aitd left of the fixation point* 

This strategy for spreading reading time over the text for a single 
subject produces a processing time profile which is a step tunctibn* 
Individual subjects' i>ro£ile8 will be different because they fixate in 
different places* At the same tlme» there should be some com}!K)nallty among 
them, reflecting the underlying processing demands represented by the 
idealized processing time profile* An example is provided in Figure 1, 
which shows the individual profiles derived from two hypotj^etical readers, 
who fixated different locations in the text, but whose f Ixatlo^durations « 
still reflect the processing time differences represented bv the ldeali/..>d 
processing time profile* Hogaboam (Note 5) reports that correlations 
between the processing time profiles for different subjects reading a single 
passage are typically positive and significant though low (in the range of 
*10)* 
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Obtaining an approximation to the Idealised processing profile from 
these Individual profiles is then a matter of averaging over subjects to 
eliminate noise and obtain an approKlmatlon to the s^ignal* When the data 
from groups of three subjects each were averaged^ and the resulting 
profiles correlated %tlth each other^ a correlation of #33 was obtained* 

^ 

This suggest that with more subjects, a stable profile over the text will 
onerge, showing Interesting variability In time required for prpcesslng 

i 

different portions of text* These profiles will provide a useful basis for 
testing theories of language processing* An example of such a profile^ 
derived from the data f rem. six siibjectSt is shown in Flgum 2* 



Insert Figure 2 abcmt here 



This approach was used to analyze the data from the ambiguous word 
study described earlier (Hogaboam» Kote 5)* Again it was found that wt»n 
the context required the most culturally frequent (primary) meaning of in 
ambiguous word» less time was spent on the word than when the less frequWt 
(secondary) meaning was required* For the primary meaning condltlont mean 
time per character over the word itself was 18 msec^ and for the secondary 
meaning condition it was 23 msec* 

As a fuiuher test of the sensitivity of such processing profiles to 
language variables, the processing profile over all instances of the 
definite article the in a 500 word passage was examined* O^Regan (1979) 
previously reported a tendency for this word to receive fewer fixations than 
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Other three letter yords^ particularly la&certaln syntactic frames* The 
processing profile shoved the mean time per character position to be 26 msac 
for instances of the word the in a passage^ as opposefl to 35/in8ec per ^ 
character position for the passage as a whole* Thus^ the profile shoved 
less time spent processing instances of the than other regions of similar . 
size in the passage* 

The passage used for this test was a historical text about earlj 
exploration of Alaska. It included several dates and other^ numbers • ^ Such 
information in a history passage is likely to be particular:^ i.^ortantt so 
the mean time per characte^osltlon for these regions was calculated from 
the average processing profile. This mean was found to be 75 msec, 
considerably higher than the average for the passage as a whole. Thus, 
there is reason to believe that this general approach to the use of eve 
movement data may be useful for testing hypotheses about where greater and 
lesser amounts of time #re 'required for language processing which takes 
place during reading* 

Summary 

This paper has been an attempt provide an overview of some recent 
research Into the nature of the on-going perceptual and language processing 
during reading* We have tried to Justify the position that eye movement 
data can be useful In Investigating these questlonst to Indicate the types 
of problems which must be solved before such data can be fully exploited for 
these purposes, and to demonstrate the types of research techniques which 
have been developed for finding answers to these problems* We have briefly 
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described a way 6t yiewing the nature of eye novement control, and dra%m out 
implications for hov eye movements are related to language^ processing and 
what kinds of information may be obtainable from eye movement data for the 
study of language processing. Finally, we have described a general approach 
to the treatment of eye movement data for use in testing theories' of 
language processing. 
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Figure Captions 



Fi^re 1* Comparison of profiles from tvoJiypothetlcal subjects* and 
the underlying^ idealised Processing Time Prof lie « ^ 

Figure 2. Processing time profile for two line? of a passage, obtained 
by averaging the profiles of six subjects. 
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